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\ n Design 
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I K Continuation. 

□ Continuation-in-part (C-I-P). 
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CERTIFICATE OF MAILING 
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"Express Mail" Mailing Label Numbe r EL024412540US 
I hereby certify that this paper or fee is being deposited with the 
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Commissioner for Patents, Washington, DC Z02M . 
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Kameron Ishikata 
Pnnt Name 



The new application being transmitted claims the benefit of U.S. Patent Application 
serial number 09/333.218 filed on June 15, 1999 . 
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3 Pages of claims 
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14 Sheets of drawings 

□ formal 

13 informal 
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□ Form PTO- 1 449 (PTO/SB/08 A and 08B) 
n Copies of cited references 

n Declaration of Biological Deposit 
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n Special Comments 
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n Showing that the filing is authorized. 
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13 An assignment of the invention to IronBridge Networks, Inc. , 

^ is attached. A separate □ "COVER SHEET FOR ASSIGNMENT (DOCUMENT) 
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□ will follow. 
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fi:om which priority is claimed 
n is (are) attached, 
d will follow. 
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petition for extension of time or to revive in that application is granted, and when this application is 
granted a filing date, so as to make this application copending with said prior application. 

9. Notification in Parent Application of this Filing 

^ A notification of this filing of this 
S continuation 

□ continuation-in-part 
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is being filed in the parent application, firom which this application claims priority under 35 U.S.C. §120. 



10. Fee Calculation (37 C.F.R. 1.16) 

CLAIMS AS FILED 



Number filed Number Extra Rate Basic Fee 

37 C.F.R. LI 6(a) 

$760.00 

Total 

Claims (37 CFR L 1 6(c)) 14 - 20 = 0 $ 1 8.00 

Independent 

Claims (37 CFR 1 . 1 6(b)) 2 - 3 = 0 $ 78.00 

Multiple dependent claim(s), 

if any (37 CFR 1.1 6(d)) + $260.00 



G:\IBNR\01 lcTi\pattransapp.wpd 



Page 3 of 5 



□ Amendment cancelling extra claims is enclosed. 

n Amendment deleting multiple-dependencies is enclosed. 

□ Fee for extra claims is not being paid at this time. 

Filing Fee Calculation $ 760.00 



1 1 . Small Entity Statement(s) 

^ Verified Statement(s) that this is a filing by a small entity under 37 CFR 1 .9 and 1.27 is (are) 
attached. 

n Status as a small entity was claimed in prior application , filed 

on from which benefit is being claimed for this application under: 

35U.S.C. □ 119(e), 

□ 120, 

□ 121, 

□ 365(c), 

and which status as a small entity is still proper and desired. 

I— I A copy of the verified statement in the prior application is included. 

Filing Fee Calculation (50% of A, B or C above) 
$ 380.00 



12. Fee Payment Being Made at This Time 

□ Not Enclosed 



n No filing fee is to be paid at this time. 

(This and the surcharge required by 3 7 C, F.R, 1.16(e) can be paid subsequently.) 

13 Enclosed 

IS Basic filing fee $ 380.00 



13 Recording assignment 
($40.00; 37C.F.R, L21(h)) 

(See attached "COVER SHEET FOR ASSIGNMENT 
ACCOMPANYING NEW APPLICATION".) $ 40.00 



Total fees enclosed $ 420.00 
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13. Method of Payment of Fees 



13 Checks in the amount of $ 380.00. 40.00 



□ Charge Account No. 12-0448 in the amount of 
A duphcate of this transmittal is attached. 



$ 



14. 



Authorization to Charge Additional Fees 



^ The Commissioner is hereby authorized to charge the following additional fees during the entire pendency 
of this application to Accoiuit No. 12-0448. 

37 C.F.R. 1.16(a), (f) or (g) (filing fees) 
^ 37 C.F.R. 1.16(b), (c) and (d) (presentation of extra claims) 

□ 37 C.F.R. 1. 1 6(e) (surcharge for filing the basic filing fee and/or declaration on a date later than the 

filing date of the application) 
n 37 C.F.R. 1.17 (application processing fees) 

CI 37 C.F.R. 1.18 (issue fee at or before mailing of Notice of Allowance, pursuant to 37 C.F.R. 1.31 1(b)) 

15. Instructions as to Overpayment 

S Credit Account No. 12-0448 
□ Refund 



Respectfully submitted, 



LAPPIN & KUSMER LLP 




Steven M. Mills 
Registration Number 36,610 
Attorney for Applicants 




Boston, MA 02109 

617-330-1300 

617-330-1311 
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4. Fourteen (14) Sheets of Informal Drawings; 
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For: APPARATUS AND MKTHOD FOR SCAT. TNG A SWTTCHTNG FABRIC IN A NETWORK SWITCHING NODE 

VERIFIED STATEMENT (DECLARATION) CLAIMING SMALL ENTITY 
STATUS (37 CFR 1.9 (f) and 1.27 (b)) - SMALL BUSINESS CONCERN 

I hereby declare that I am 

□ the owner of the small business concern identified below: 

E an official of the small business concern empowered to act on behalf of the concern identified below: 

NAME OF CONCERN IronBridge Networks, Inc. 

ADDRESS OF CONCERN 55 Hayden Avenue, Lexington, Massachusetts 02173 



I hereby declare that the above identified small business concern qualifies as a small business concern as defined in 13 CFR 121.3-18, and 
reproduced in 37 CFR L9(d), for purposes of paying reduced fees under section 41(a) and (b) of Title 35, United States Code, in that the 
number of employees of the concern, including those of its affiliates, does not exceed 500 persons. For purposes of this statement, (1) the 
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either, directly or indirectly, one concern controls or has the power to control the other, or a third party or parties controls or has the 
power to control both. 

-thereby declare that rights under contract or law have been conveyed to and remain with the small business concern identified above with 
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by inventor(s) 
described in 
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,"3f the rights held by the above identified small business concern are not exclusive, each individual, concern or organization having rights to 
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;^j^mall business concern under 37 CFR 1.9 (d) or by any concern which would not qualify as a small business concern under 37 CFR 1.9 (d) 
I ybr a nonprofit organization under 37 CFR 1.9 (e), 

: *NOTE: Separate verified statements are required from each named person, concern or organization 

having rights to the invention averring to their status as small entities. (37 CFR 1.27) 
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punishable by fine or imprisonment or both, under section 1001 of Title 18 of the United States Code, and that such willful false statements 
may jeopardize the validity of the application, any patent issuing thereon, or any patent to which this verified statement is directed. 
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APPARATUS AND METHOD FOR SCALING A SWITCHD^G FABRIC IN A NETWORK 



SWITCHING NODE 

Related Applications 

5 This application is a continuation of U,S. application serial number 09/333,218, filed on 

June 15, 1999, the contents of which are incorporated herein in their entirety by reference. 

Background of the Invention 

In many complex systems such as digital communications systems, switching systems or 
10 "switching fabrics" are employed to route data between system modules. For example, in a 

network node on a digital network, a switching fabric can be used to route data packets between 
ports on the node, each of which, in a general bidirectional system, can serve as both an input 
port and an output port. The switching nature of the fabric refers to its ability to controUably 
^ route individual data packets from one of many data ports to another of the data ports. 
15 J:f^ Some switching fabrics are implemented as multiple switch "planes" or "slices", each of 

' which handles a portion of the total switching capabiUty of the fabric. The switch planes are 
2^ allocated in a configiu'ation which in general permits each port to transfer data to all of the ports, 

including through the switching fabric back to itself Consequently, switch planes can be 
^; extremely complex pieces hardware which can be very expensive to implement. It would 
20 £ therefore be beneficial to reduce the number of planes required to implement the switching 
fabric. 

Summary of the Invention 

The present invention provides a method and apparatus which reduces the number of 
25 switch planes required to implement a switch fabric by altering how the switch planes and data 
ports are allocated. The system of the invention is applicable in a system such as a network 
switching node in which data are transferred among a plurality of interface units, each having a 
plurality of data ports, connected across a switching fabric of node switching circuitry. The 
fabric is partitionable into a plurality of switch planes such that each switch plane is assignable to 
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transfer data associated with a like data port of the plurality of interface units. Each switch plane 
includes multiple switching channels each assignable to transfer data associated with one data 
port on one of the interface units. In accordance with the invention, a number of interface units 
connected to the switch fabric is determined. If the number of interface units is less than the 
number of switching channels in each switch plane, then, for at least one of the switch planes, a 
first channel of the switch plane is assigned to transfer data associated with a first data port of a 
first interface unit and a second channel in the at least one switch plane is assigned to transfer 
data associated with a second port of the first interface unit. 

Thus, in accordance with the invention, when a full implementation of one switch plane 
for each hke port of all of the interface units results in unused channels in the switch planes 
because there are more channels in each plane than there are interface units connected to the 
switch fabric, then the switch channels can be reallocated among the data ports of the interface 
units such that each switch plane can include channels assigned to more than one port of one or 
more interface units. The reallocation of the invention results in channels of switch planes that 
would have been unused in a full implementation being used to transfer data. In one 
embodiment, as a result of the reallocation, one or more switch planes can have no channels 
assigned to transfer data, such that one or more switch planes can be eliminated from the switch 
fabric, resulting in substantially reduced fabric hardware cost and complexity. 

In one embodiment of the invention, the assignment of ports to channels and/or switch 
planes is accomplished via an allocation table stored in a memory. Each port is assigned its own 
unique allocation table. The table for a port defines an association between a destination 
interface unit, i.e., an interface unit to which a data packet is being transferred, and a channel of 
the switch plane with which the port is associated. That is, each data packet to be routed across 
the switch fabric includes information identifying the interface unit to which the packet is to be 
transferred. The port transferring the packet uses its allocation table to identify the channel in its 
switch plane through which the data packet should be routed to reach its destination interface 
unit. 

In one embodiment of the invention, the reallocation of the switching circuitry involves 
creating a new allocation table for one or more ports in one or more interface units. The 
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allocation table is altered to create a new association between destination interface units and 
switch plane channels such that data can be routed from the port to the destination interface unit 
connected to the new switch plane channel identified by the reallocation. In addition to this 
regeneration of an altered allocation table, physical connections, e.g., by optical fiber, are 
5 rerouted to ensure that ports are connected to switch plane channels according to the reallocation. 
The reallocation method and apparatus of the invention provide a scalable switching 
fabric. The scaling can be performed as described above to reduce the size and hardware 
complexity and, therefore, the cost of the switching fabric in cases where fewer interface units 
are used than would be used in a fiill implementation. Likewise, the reallocation can be reversed 
10 such that the switching fabric can be scaled back to a larger size in the event that it is desired to 
add interface units to the fabric. Therefore, the reallocation of the invention provides for a 
flexible scalable switching fabric which can be sized up and down depending upon changing 
;5 system requirements, 

Q In one embodiment of the invention, the reallocation incorporates a systematic symmetric 

1 5 flj reassignment of channels and ports. This symmetric reassignment can be referred to as a 
J' symmetric "folding" of the switch fabric. Using this fabric folding approach to reallocating 

switching channels, a logically ordered reallocation is achieved. For example, one "fold" of the 
flj fabric can result in an implementation that requires half of the switch planes that would be 
S required for a fixll implementation. 
20 In one embodiment, a fiiU implementation of the switching circuitry includes as many 

switch planes as there are ports in each interface unit. That is, if each interface unit includes M 
ports, then the switching fabric is implemented using M switch planes. Each switch plane 
includes as many chaimels as there are interface units. That is, if N interface xmits are connected 
to the switch fabric, then each switch plane includes N channels. Each interface unit includes 
25 one connection to each of the switch planes, and each switch plane contains one cormection to 

each interface unit via each of its channels. In one particular implementation, like ports of all of 
the interface units are connected to a single switch plane. That is, for example. Port 1 of all of 
the interface units is connected to switch Plane 1, Port 2 of all of the interface units is connected 
to switch Plane 2, etc., and port M of all of the interface units is connected to switch Plane M. 
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Hence, there are as many switch planes as there are ports in each interface unit and there are as 
many channels in each switch plane as there are interface units. In one particular embodiment, 
the switch fabric is capable of connecting to sixteen interface units, i.e., N = 16; and each 
interface unit includes 12 ports, i.e., M = 12. 
5 When fewer than the full N interface units are implemented, fewer than N switch 

channels are used on each switch plane. In accordance with the invention, the switch planes are 
reallocated such that ports of the interface units that are implemented are assigned to channels on 
switch planes that they would not have been assigned to if a full implementation were used. For 
example, where only eight interface units are used in a system in which a full implementation 
10 includes 16 interface units of 12 ports each, two ports from the interface units can be routed to 

two channels on a single switch plane, instead of only one port being routed to each switch plane. 
^ In this way, the otherwise unused channels on each of the planes are used, and the remaining 
O completely unused switch planes need not be implemented. In this example, six switch planes 
^ can be omitted and the remaining six switch planes, each having sixteen switch channels, can be 
15 connected to two ports of each interface unit. Hence, by scahng or "folding" the switch fabric, 
^ the number of switch planes that must be implemented can be reduced, in this case, by half. 
=;B Hence, the switch reallocation apparatus and method of the invention provides a means 

for substantially reducing the amount of hardware required to implement a switch fabric in a 
=3 switching node in which the full data switching capability of the node is not implemented, either 
20 on a temporary or permanent basis. By reallocating the port connections to the switch fabric, the 
number of switch planes that must be implemented can be substantially reduced, leading to 
reduced hardware complexity and cost. The invention also provides the capability of scaling or 
"unfolding" the switch fabric back up to a larger implementation to accommodate expansion of 
the system by addition of new interface units. 
25 The apparatus and method of the invention used to implement data switching circuitry is 

applicable in various systems such as networks in which data are transferred. For example, the 
invention can be implemented in a switching node of the type described in copending U.S. patent 
application serial number 09/108,771, filed on July 2, 1998, entitled "System and Method for 
Switching Packets in a Network," by Schwartz, et al., and assigned to the same assignee as the 
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present application. The contents of that application are incorporated herein in their entirety by 
reference. 

Brief Description of the Drawings 
5 The foregoing and other objects, features, and advantages of the invention will be 

apparent from the following more particular description of preferred embodiments of the 
invention, as illustrated in the accompanying drawings in which like reference characters refer to 
the same parts throughout the different views. The drawings are not necessarily to scale, 
emphasis instead being placed upon illustrating the principles of the invention. 
1 0 FIG. 1 is a schematic block diagram of a network that includes at least one switching 

node which incorporates the switching circuitry scaling apparatus and method of the invention. 
^ FIG. 2 is a schematic functional block diagram of a switching node in the network of 

FIG. 1 which incorporates the switching circuitry scaling apparatus and method of the invention, 
Q FIG. 3 is a schematic block diagram of a switching node in a full implementation 

1 5 rrj connection of four interface units across a switching fabric having four switch planes of four 
"'^^ switching channels each. 

Q FIG. 4 contains port allocation tables for the interface unit ports in the system of FIG. 3. 

fll FIG. 5 is a schematic block diagram of the system of FIG. 3 using two interface units 

f^ ^ instead of four. 
20 yB FIG. 6 contains port allocation tables for the system of FIG. 5. 

FIG. 7 contains a schematic diagram of switching channel reallocation of the system of 
FIG. 5 in accordance with one embodiment of the present invention. 

FIG. 8 contains a schematic block diagram of switching channel and interface unit port 
assignments reallocated in accordance with one embodiment of the present invention. 
25 FIG. 9 contains port allocation tables for the reallocated switch fabric of FIG. 8. 

Detailed Description of Preferred Embodiments 

FIG. 1 schematically depicts a computer network 10 in which the invention can be 
appUed. The network 10 includes a plurality of switching nodes 11(1) through 1 1(N), generally 
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identified by reference numeral 1 1, for transferring signals representing data among a number of 
devices, which in FIG. 1 are represented by packet source/destination devices 12(1) through 
12(M), generally identified by reference numeral 12, in a wide area network ("WAN"). The 
packet source/destination devices 12 can include a particular device such as a computer system 
or other device that stores, generates, processes or otherwise uses digital data. It can also be a 
local area network of such devices. Each packet source/destination device 12 is connected over a 
communication link, generally identified by reference numeral 13, to a switching node 1 1 to 
facilitate transmission of data thereto or the reception of data therefrom. 

The switching nodes 1 1 are interconnected by communication links, also generally 
identified by reference numeral 13, to facilitate the transfer of information among the respective 
switching nodes 1 1 . The communication links 13 may utilize any convenient information 
transmission medium, including, for example, wires for carrying electrical signals, optical fiber 
links for carrying optical signals, and so forth. Each communication link 13 is preferably 
bidirectional, allowing the switching nodes 11 to transmit and receive signals among each other 
and with customer premises equipment 12 connected thereto over the same link. Depending on 
the particular type of medium selected for respective communication links 13, multiple media 
may be provided for transferring signals in opposite directions thereby to provide the 
bidirectional link. 

Data are transferred in the network 1 0 in the form of packets. Generally, a packet 
includes a header portion and a data portion. The header portion includes information that assists 
in routing the packet through the network, with the specific information depending on the 
particular packet routing protocol that is used in routing packets through the network. In 
connection with network 10, any of a number of well-known packet routing protocols may be 
used; in one embodiment, the well-known Internet protocol ("IP") is used. In any case, the 
header typically includes address information including a source address identifying the 
particular source device 12(ms) that generated the packet and a destination address identifying 
the particular destination address 12(mD) that is to receive the packet. In the IP protocol, a packet 
may be of variable length, and the header typically will also include length information to 
identify the length of the packet. The header also typically includes other information, including, 
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for example, protocol identifier information that identifies the particular protocol that defines the 
structure of the packet. The data portion contains the data pay load of the packet. The packet 
may also include, as part of the data portion or otherwise, error detection information that can be 
used to determine whether an error occurred in transferring the packet. 
5 A source device 12(ms), after generating a packet for transfer to a destination device 

I2{mj^), will provide the packet to the switching node 11 to which it is connected. The switching 
node 1 1 uses the destination address in the packet to attempt to identify a route over which it is to 
transfer the packet to forward the packet to either the destination device I2(mj^), if the switching 
node 1 l(n) is connected to the destination device 12 (mo), or to another switching node 1 l(n) 
10 (n'^n) along a path to the destination device 12(mD). The route associates a destination address 
with one of the communication links 13 connected to the switching node. If the switching node 
Q can identify a route for the received packet, it will forward the packet over the communication 
£ link identified by the route. Each switching node 1 l(n), 1 l(n'),..., that receives the packet will 
perform a similar operation. If all of the switching nodes have respective routes for the 
15 destination address, the packet will eventually arrive at the destination device 12(mD). 

FIG. 2 contains a functional block diagram of one embodiment of a switching node 1 1 
---^^ which uses the switch fabric scaling or "folding" apparatus and method of the invention. The 
^ switching node 1 1 includes N interface units 20(1), 20(2)..., 20(N), labeled lUl , IU2,..., lUN, 
i*U respectively, connected to switching circuitry 27. Each interface unit 20 includes multiple ports 
20 .j5 15(1), 15(2),...,15(N) for connecting the interface units to the network communication links 13. 
In general, data can be received from and transferred to the network into and out of the interface 
units 20 via the ports 15. Each interface unit 20 also includes M ports which are connected to 
switching circuitry 27. Data being transferred between interface units 20 are forwarded out of 
one of the ports, i.e.. Port 1, Port 2, Port M, of one of the interface units 20 to the switching 
25 circuitry 27, where the data are routed according to a predefined destination to one of the 

interface units 20 for transfer onto the network. Each of the connections between the ports and 
the switching circuitry 27 is bidirectional such that data can be forwarded in and out of the 
interface units 20 via the lines connected to the ports. Also, data can be transferred out of one of 
the interface units 20, through the switching circuitry 27, and back out through the same interface 

IBNR-011 -7- 



unit 20. 

The switching circuitry 27 includes a packet switch or "switch fabric" 22 which routes 
data packets between the interface units 20. The switching circuitry 27 also includes processing 
circuitry 25 which oversees and controls the routing of data packets through the switch fabric 22. 
5 In one embodiment, the packet switch 22 is in the form of a crosspoint switch. More 

specifically, the switch fabric 22 is implemented in the form of a plurality of switch planes, in 
one embodiment, M switch planes, 23(1), 23(2),..., 23(M), each of which is the form of a 
crosspoint switch. Providing multiple switch planes 23 in the packet switch 22 allows for more 
rapid switching of packets through the switch fabric, allowing for higher throughput of packets 
10 between the interface units 20. In addition, if one of the switch planes 23 fails or otherwise 
malfunctions, it can be removed from the system or bypassed by a parallel plane 23. Further 
'^^ details of the hardware implementation of the switch plane are described in copending U.S. 
applications serial number 09/1 08,77 1 , filed on July 2, 1 998, incorporated herein by reference. 
In general, in a fully implemented system, the packet switch 22 includes as many switch 
15 ^ planes 23 as there are ports in each interface unit 20 connected to the switch fabric 22. In the 
illustration of FIG. 2 there are M ports in each interface unit 20 and, accordingly, the switch 
'3 fabric 22 is implemented with M switch planes 23. In this full implementation, each switch 
1;^ plane 23 includes N switching channels 29, labeled CHI, CH2,.„, CHN, connected to the ports 
; ^ for routing data between the ports. Within a single switch plane 23, each channel CHI , CH2,..., 
20 'S CHN, is connected to one port from each of the N interface units 20. In one particular full 
implementation, like ports of all of the interface units 20 are connected to a single plane 23. 
That is, for example, all of the Port Is fi*om all of the interface units 20 are connected to a single 
switch plane, e.g.. Plane L Likewise, all of the N Port 2s can be connected to the N channels, 
CHI , CH2,...CHN, of Plane 2. Since there are N interface units 20 and N channels CHI, CH2,..., 
25 CHN, in the plane 23(1), the full implementation is achieved when all of the ports from all of the 
interface units are connected to all of the channels of all of the planes. 

As a result of this full implementation connection, within each plane, all interface units 
20 can communicate bidirectionally with all of the interface units 20 within each of the 
individual planes 23. For example, if a data packet is received at IU2 for transmission to IU8, 
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one of the ports of IU2 is selected for transmission of the packet. If, for example, the selected 
port is Port 2, the packet is routed into Channel 2 of Plane 2 and out of Channel 8. Channel 8 of 
Plane 2 is connected to Port 2 of IU8. Therefore, the packet is routed out of Plane 2 through 
Channel 8 back to Port 2 of IU8. 
5 To implement the proper routing of packets, each interface unit 20(1), 20(2),...,20(N) 

includes processing circuitry 17(1), 17(2),..., 17(N), respectively. An allocation table or remap 
table is stored in a memory 19(1), 19(2),,.., 19(N) in each interface unit 20(1), 20(2),..., 20(N). 
Each port is assigned its own allocation table. Each allocation table stored in the memory 19 
associates its port with a switch channel 29 through which packets should be routed to reach the 
10 designated destination interface unit. Therefore, for each interface unit 20, M allocation tables 
are stored in the memory 19. The allocation table defines a relationship between the associated 
•^S port and the switch channel that is to be used to route data to the destination interface unit. 
□ Hence, for a full implementation as shown in FIG. 2, the memory 19 in each interface unit 20 
% stores M allocation tables, one for each port. Within each allocation table, there are N entries for 
15;^^ each possible destination interface unit. For example, the allocation table for Port 2 of IU2 
i= includes a relationship between each destination interface unit and Port 2 of IU2. For example, 
% in that table, the entry for IU7 would be channel 7 (C7), since data packets transferred via Port 2 

to switch Plane 2 will enter the plane through Channel 2 and exit the plane through Channel 7. 
s3 Each packet will accordingly be routed via Channel 7 out to Port 2 of IU7. 
20 When a data packet being transferred by an interface unit 20 is formatted for transfer 

across the switch fabric 22, the associated processor 17 selects a port for the transfer and then 
reads the associated allocation table stored in the memory 19 to determine the channel for routing 
the data to the destination interface unit. That channel information is attached or apended to the 
data packet being transferred such that the switch plane 23 can properly route the data packet to 
25 the appropriate channel. 

In many instances, fewer than the maximum N interface units 20 will be implemented. 
As a result, in each switch plane, fewer than the N total channels are utiUzed. This results in 
wasted expensive hardware being implemented in a system. In accordance with the present 
invention, connections between ports of the interface units that are actually implemented are 
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formatted to use channels of switch planes that are available and would otherwise go unused 
because fewer than the maximum M interface units are implemented. In the present invention, 
this reallocation includes regenerating the allocation or remap tables for the ports in the interface 
units that are implemented and connecting the interface units to the appropriate channels of the 
5 switch planes. As a result, by properly selecting the allocation of channels, switch planes can be 
eliminated from the implementation, resulting in substantial cost savings. 

The reallocation of the switching circuitry of the invention will now be described in detail 
with reference to FIGs. 3-9. For clarity and ease of description, the invention is described in 
terms of a system whose full implementation configuration includes four switch planes each 
10 having four channels and being connected to four interface units, each having four ports. It will 
be understood that the details of the invention described in connection with this illustrative 
exemplary embodiment are applicable to systems having full implementations including any 
nxmiber of interface units, ports, switch planes and switch plane chaimels. In particular, the 
Q invention is applicable to the specific embodiment in which the full implementation includes 12 
15 ffi switch planes of 16 channels each and 16 interface units, each of which has 12 ports. 

FIG. 3 is a schematic block diagram of a portion of a switching node 1 1 showing a fixll 
3 implementation configuration in which four interface units 20(1),..., 20(4) each having four ports 
iry are connected to a switch fabric 22 which includes four switch planes 23(1),..., 23(4), each of 
•J which includes four switching channels CI,..., C4. As shown in FIG. 3, each of the interface 
20 B units 20 is associated with a channel of the switch planes 23. That is, lUl is associated with 
Channel 1 of all of the switch planes, IU2 is associated with Channel 2 of all of the switch 
planes, IU3 is associated with Channel 3 of all of the switch planes, and IU4 is associated with 
Channel 4 of all of the switch planes. Likewise, like ports of all of the interface units are 
associated with one of the switch planes. That is, Port 1 of all four interface units 20 is 
25 connected to Plane 1, Port 2 of all four interface units 20 is connected to Plane 2, Port 3 of all 
four interface units 20 is connected to Plane 3, and Port 4 of all four interface units 20 is 
connected to Plane 4. Using this connection scheme, each port of all of the interface units can 
communicate with a port of all of the interface units. Therefore, full bandwidth communication 
among the interface units is implemented. 
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FIG. 4 contains allocation tables for each of the four ports on each of the four interface 
units shown in FIG. 3. Each allocation table defines a channel of a switch plane through which a 
data packet or message routed through a particular port should be forwarded to reach the 
destination interface unit. That is, for each port, the associated allocation table defines the 
5 channel of the port's associated switch plane through which data packet should be routed to reach 
a particular interface unit. For example, the lUl Port 2 table shows that data packets being 
forwarded to IU2 should be routed through Channel 2 of the switch plane. Data packets being 
routed to IU3 should be routed through Channel 3, data packets being routed to IU4 should be 
routed through Channel 4, and packets being routed back to lUl should be forwarded through 
10 Channel 1. 

When a packet is to be transferred, it arrives at a distribution function block of the 
:yfl sending interface unit addressed to a particular destination interface unit. The distribution block 
selects one of the ports of the sending interface unit through which the packet is to be transferred. 
The processing circuitry accesses the memory associated with that port to read its allocation 
15 lU table. The destination lU nvimber associated with the packet is replaced with the channel number 
^, " read from the allocation table for the destination interface unit. The message is then transferred 

out of the selected port of the sending interface unit toward the switch plane 23 of the switch 
ru fabric 22 associated with the sending port. The packet is routed through the plane 23 to the 
.^O selected channel and then to the selected destination interface unit via the port connected to the 
20 channel 29. 

FIG. 5 is a schematic block diagram which illustrates the system of FIG. 3 in which only 
two interface units 20(1), 20(2) are implemented instead of the four interface units shown in the 
full implementation of FIG. 3. As shown in FIG. 5, with two interface units implemented, two 
channels 29 on each of the switch planes 23 are unused. Therefore, in this implementation, one 
25 half of the implemented hardware is wasted. In accordance with the invention, the assignment of 
switch planes to lU ports is reallocated to utilize unused switch plane channels 29 such that entire 
switch planes 23 can be eliminated, thus substantially reducing the cost of implementing the 
system. FIG. 6 contains allocation tables for the implementation of FIG. 5. 
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FIG. 7 is a schematic block diagram which illustrates one embodiment of the reallocation 
process of the invention in which unused chaimels 29 are used to implement cormections 
previously assigned to other channels on other switch planes 23. Specifically, as schematically 
illustrated by circle 7 and arrows 5, the connections previously assigned to Channels 1 and 2 of 
Plane 3 are moved to Channels 3 and 4 of Plane 1. Likewise, the connections previously 
allocated to Channels 1 and 2 of Plane 4 are moved to Channels 3 and 4 of Plane 2. As a result 
of this reallocation, Planes 3 and 4 become completely unused and therefore need not be 
implemented. This switching fabric scaling or "fabric folding" results in an efficient 
implementation of the switching fabric which allows substantial, e.g., one-half, reduction in 
hardware implementation complexity and cost. 

FIG. 8 is a schematic block diagram which illustrates the results of the reallocation shown 
in FIG. 7. As shown, the two interface units 20(1), 20(2) are fiiUy connected across only two 
switch planes 23(1), 23(2), as opposed to the four switch planes utilized before the reallocation 
process of the invention. As shown in FIG. 8, each port of both interface units can communicate 
with both interface units within a single switch plane 23. Therefore, even though half of the 
switching hardware is used to implement system, there is no reduction in data transfer 
bandwidth. 

In accordance with the invention, in addition to making the reallocated port/switch 
hardware connections shown in FIG. 8, new allocation tables are generated for each port. FIG. 9 
contains the allocation tables for the reallocated switching circuitry of FIG. 8. As illustrated by 
the tables of FIG. 9 and the schematic depiction of FIG. 7 of the reallocation process, for the 
ports that are reallocated to the unused channels of switch Planes 1 and 2, the allocation tables 
are altered. That is, the allocation tables for Ports 3 and 4 of both lUl and IU2 are changed to 
identify the new remapped channels, i.e., the formerly unused channels, of Planes 1 and 2. 

Thus, in accordance with the invention, a scalable switching fabric is achieved in which 
inefficiencies associated with under-utilization of switching capabilities can be substantially 
reduced. As described above, where fewer interface units are connected to the switch fabric, the 
switching circuitry can be reallocated to utilize unused switching channels. This is accomplished 
by physically routing switch connections fi'om the lU ports to the switch channels in accordance 
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with the reallocation. In addition, allocation tables associated with each port are updated such 
that data packets are properly routed through the switch fabric. 

Not only can the switching fabric be scaled down or 'Tolded' as described above, but the 
fabric can also be scaled back up or "unfolded" as desired. While operating in a scaled down or 
5 folded configuration, it may be desirable to add additional interface units to the switch fabric to 
expand the capabilities of the system. In this case, the folded fabric can be unfolded by making 
new connections as desired between the lU ports and the switching channels. In addition, new 
allocation tables can be produced to accommodate the unfolding or scale-up process. Hence, an 
extremely flexible scalable switch fabric is provided which can accommodate many changes to 
10 the degree to which the switching capabilities are utilized. In unfolding, it may also be necessary 
to add one or more switch planes back into the fabric. 
3 The foregoing describes in detail the reallocation method and apparatus of the invention 

in terms of a system using four interface units each having four ports and a switching fabric 
having four switch planes of four switch chanuaels each. It will be understood that the features of 
1 5 the invention are applicable to a switching circuitry having any number of switch planes of any 
^j number of switching channels each being connected to any number of interface units. For 
::5 example, the invention is appUcable to one embodiment in which a full implementation includes 
:Sl sixteen interface units of twelve ports each connected to twelve switch planes of sixteen 
ro switching channels each. 
20 J In accordance with the invention, the switch fabric can be scaled or "folded" to a number 

of possible configurations to eliminate switch planes, depending upon various factors, including 
the number of interface units implemented. FIGs. 10-14 are schematic illustrations of various 
fabric folding configurations in accordance with the invention. These examples are appHed to 
the system in which each interface unit includes twelve ports implemented on two fabric 
25 interface (FI) cards of six ports each. In one particular embodiment, only five of the six ports on 
each FI card are implemented. These examples also illustrate switching planes or "sUces" having 
sixteen switching chaimels each for connecting to up to sixteen interface units. As described 
above, when fewer than sixteen lUs are implemented, the excess switching channels of the 
switch planes are normally unused, in the absence of the reallocation of the present invention. In 
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the case of a normal system with K interface units, channel numbers K + 1 through 16 will be 
unused on each fabric plane. In accordance with the fabric folding approach of the invention, the 
otherwise unused ports are used to emulate additional switch fabric planes. 

In a preferred system, Uke numbered fabric ports for the various interface units should be 
connected to the same fabric plane. For example, Port 1 in each interface unit should be 
connected to the same fabric plane, e.g., Plane L This particular fabric plane, however, may also 
connect to other ports. Because of this constraint, there is in one embodiment a geometric 
ordering of the fabric folding technique. Each fabric folding configuration can be classified or 
characterized as K:l, where K represents the number of times that each fabric plane is reused to 
represent another virtual fabric plane. Thus, in a 5:1 folded fabric, five channels are used in a 
plane for one interface unit. 

The examples of folded fabrics shown in FIGs. 10-14 will now be described in detail. It 
is noted that a single interface unit does not require any fabric planes because it is possible to 
loop back the port interfaces upon themselves. However, once two interface units are used, 
folded fabric configurations can be introduced. For example, with two interface units, the 5: 1 
folded fabric configuration of FIG. 10 can be used. This configuration utilizes each fabric plane 
to emulate five virtual fabric planes. With this configuration, two to three interface units can be 
supported. To support this level of folding, this configuration only uses the minimum of five 
fabric ports on each FI card required to maintain fiill traffic bandwidth. There are not enough 
channels on the two switch fabric planes to support six fabric ports on each fabric interface card. 
With five ports in use however there is one spare channel on each fabric plane that can be 
utilized during a fabric upgrade while avoiding bandwidth degradation during the upgrade. In 
FIG. 10 the illustrated port pairings are chosen to represent the easiest visualization of the 
interconnections. As with other folded fabric configurations, many other port pairings are 
possible. Eventual port pairings should be chosen to minimize the cable migrations required 
between the eventual supported folded fabric configurations. 

FIG, 1 1 schematically illustrates a 4:1 folded fabric configuration. This configuration 
uses three fabric planes, but is only capable of supporting one additional interface unit over the 
5:1 configuration. Once again, the fabric port pairings shown in FIG. 1 1 are one of many 

IBNR-011 -14- 



possible pairings. 

FIG. 12 illustrates a 3:1 folded fabric configuration, which adds another fabric plane to 
the system, but again only allows a single additional interface unit over the 4:1 configuration. 
Utilizing a total of four fabric planes, this configuration supports five interface units. 
5 FIG. 13 illustrates a 2:1 folded fabric. There are actually two different configurations of 

2:1 folding depending on whether five or six fabric ports on the FI cards are supported. The 2:1 
folding means that two different port numbers on each FI card utihze the same fabric plane. Five 
fabric planes are required to support the minimum five fabric ports on each FI card. A sixth 
fabric plane allows support of the sixth fabric port. 
10 This fabric configuration is valid for up to eight interface units. The detailed 

interconnections for five fabric planes are illustrated in FIG. 13. FIG. 14 illustrates the 2:1 
O folded fabric configuration using six fabric planes. It should be noted that in FIGs. 13 and 14, 
:£ for clarity of the illustrations, the connections for six to eight interface units are omitted. 
I^J While this invention has been particularly shown and described with references to 

15 preferred embodiments thereof, it will be understood by those skilled in the art that various 
\j changes in form and details may be made therein without departing from the spirit and scope of 
^ the invention as defined by the appended claims. 
What is claimed is: 
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CLAIMS 



1 1 , A method of reallocating switching circuitry in a switching fabric to permit data transfer 

2 among a pluraUty of interface units each having a plurality of data ports, the switching 

3 fabric being partitionable into a plurality of switch planes such that each switch plane is 

4 assignable to transfer data associated with a like data port of the pluraUty of interface 

5 units and each switch plane including multiple switching channels each being assignable 

6 to transfer data associated with one data port of one of the interface units, the method 

7 comprising: 

8 determining a number of interface units connected to the switching fabric; 

9 determining a number of switching channels in each switch plane; and 

10 =5 if the number of interface units is less than the number of switching channels in 

1 1 J5 each switch plane, for at least one of the pluraUty of switch planes, assigning a first 

12 O channel in the switch plane to transfer data associated with a first data port of a first 

13 ftj interface unit and assigning a second channel in the switch plane to transfer data 

14 ' associated with a second data port of the first interface unit. 

1 fil 2. The method of claim 1 wherein each interface unit comprises twelve data ports. 

1 3. The method of claim 1 wherein each switch plane comprises sixteen switching channels. 



1 4. The method of claim 1 wherein switching circuitry is reallocated such that the number of 

2 switch planes in the switching fabric can be reduced. 

1 5. The method of claim 1 wherein the switching circuitry is reallocated such that the number 

2 of switch planes in the switching fabric can be reduced by one half. 
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1 6. The method of claim 1 wherein switching channels in the switch planes are assigned to 

2 data ports via an allocation table stored in a memory. 

1 7. The method of claim 6 wherein the switching circuitry is reallocated by updating the 

2 allocation table, 

1 8. An apparatus for reallocating switching circuitry in a switching fabric to permit data 

2 transfer among a plurality of interface units each having a plurality of data ports, the 

3 switching fabric being partitionable into a plurality of switch planes such that each switch 

4 plane is assignable to transfer data associated with a like data port of the plurahty of 

5 % interface units and each switch plane including multiple switching channels each being 

6 assignable to transfer data associated with one data port of one of the interface units, the 

7 □ apparatus comprising: 

8 ^ a memory for storing an allocation table that stores assignments of the switching 

9 channels to data ports of the interface units; and 

10 □ a processor for (I) determining a number of interface units connected to the 

1 1 ^ switching fabric, (ii) determining a number of switching channels in each switch plane, 

1 2 and (iii) if the number of interface units is less than the number of switching channels in 

13 fl each switch plane, for at least one of the plurality of switch planes, assigning a first 

14 channel in the switch plane to transfer data associated with a first data port of a first 

15 interface unit and assigning a second chaxmel in the switch plane to transfer data 

16 associated with a second data port of the first interface unit. 

1 9. The apparatus of claim 8 wherein the processor updates the allocation table to include 

2 new assignments of the switching channels to data ports of the interface units. 

1 10. The apparatus of claim 1 wherein each interface unit comprises twelve data ports. 
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The apparatus of claim 1 wherein each switch plane comprises sixteen switching 
channels. 

The apparatus of claim 1 wherein the switching circuitry is reallocated such that the 
number of switch planes in the switching fabric can be reduced. 

The method of claim 1 wherein switching circuitry is reallocated such that the number of 
switch planes in the switching fabric can be reduced by one half. 

The method of claim 6 wherein the switching circuitry is reallocated by updating the 
allocation table. 
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APPARATUS AND METHOD FOR SCALING A SWITCHING FABRIC IN A NETWORK 



SWITCHING NODE 

Abstract of the Disclosure 
5 A method and apparatus for reallocating switching circuitry in a switching fabric are 

disclosed. The switching fabric is used to permit data transfer among a plurality of interface 
units each having a plurahty of data ports. The switching fabric is partitionable into a plurality 
of switch planes such that each switch plane can be assigned to transfer data associated with like 
data ports of the interface units. Each switch plane includes multiple switching chaimels each 
10 assignable to transfer data associated with one data port of one of the interface units, in a full 

implementation. The number of interface units is less than the number of switching chaimels in a 
-0 switch plane, then the reallocation is performed such that multiple channels of at least one switch 
3 plane can be assigned to transfer data of multiple ports of at least one of the interface units. This 
results in switch plane channels that would otherwise be unused being utilized to transfer data. 
1 5 ^ y This reallocation of switch plane channels can result in the elimination of one or more switch 
planes from the switch fabric resulting in substantially reduced hardware complexity and cost. 
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application or any patent issued thereon. 





Date 2j^^i^p>i^f^ 


FullN^ffieof 
1st Inventor 


Family Name 

Carlson 


First Given Name 

James 


Second Given Name 

D. 


Residence & 
Citizenship 


City 

North Andover 


State or Foreign Country 

Massachusetts 


Country of Citizenship 

U.S.A. 


Post Office 
Address 


Post Office Address 

25 Essex Street 


City 

North Andover 


State & Zip Code/Country 

MA, 01845, U.S.A- 
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DECLARATION, PETITION AND POWER OF ATTORNEY FOR 
PATENT APPLICATION 


Attorney Docket No: 
IBNR-OllCN 


Signature / / , 

A 11 




Date 


FuUlSlame of 
1st Inventor 


Family Name 

Schwartz 


First Given Name 

Steven 


Second Given Name 
J. 


Residence & 
Citizenship 


City 

Sudbury 


State or Foreign Country 

Massachusetts 


Country of Citizenship 

U.S.A. 


Post Office 
Address 


Post Office Address 

18 Blueberry Hill Lane 


City 

Sudbury 


State & Zip Code/Country 

MA, 01776, U.S. A. 


Signature^^^^^^^ 




Full Name of 
1 St Inventor 


Family Name 

Spada 


First Given Name 

Eric 


Second Given Name 
J. 


Residence & 
Citizenship 


City 

Lexington 


State or Foreign Country 

Massachusetts 


Country of Citizenship 

U.S.A. 


Post Office 
Address 


Post Office Address 

1102 Lexington Ridge Drive 


City 

Lexington 


State & Zip Code/Country 

MA, 02421, U.S.A. 


:l Signature ^^^^^^^^^^ ^ " / ^^^^^ 


Date / /^^^ 


^^Full Name of 
: n St Inventor 


Pelletier 


First (^t^m Najjn^ 

Eric 


Second Given Name 
J. 


^ I: Residence & 
~ I Citizenship 


City 

Lexington 


State or Foreign Country 

Massachusetts 


Country of Citizenship 

U.S.A, 


,iPost Office 
Address 


Post Office Address 

148 Wood Street, Apt. 3 


City 

Lexington 


State & Zip Code/Country 

MA, 02421, U.S.A. 




Date ^ / ] 


' Full Name of 
J 1st Inventor 


Family Name 

Koehler 


First Given Name 

Jeffrey 


Second Given Name 

A. 


\ Residence & 
Citizenship 


City 

Westborough 


State or Foreign Country 

Massachusetts 


Country of Citizenship 

U,S.A. 


Post Office 
Address 


Post Office Address 

155 Milk Street, Apt. 2 


City 

Westborough 


State & Zip Code/Country 

MA, 01581, U.S.A. 



G:\IBNR\01 icnXdecpoa.wpd 



Page 3 of 3 



